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Abstract 

We present a simple model for the formation of pairs in multi-agent populations of 
type A and B which move freely on a spatial network. Each agent of population 
c/3 I A (and B) is labeled as Ai (and Bj) with i = 1,...,Na (and j = 1, . . . ,Nb) 

CZ2 ■ and carries its own individual list of characteristics or 'phenotype'. When agents 

.,-H . from opposite populations encounter one another on the network, they can form a 

^.,^1 relationship if not already engaged in one. The length of time for which any given 

^ ■ pair stays together depends on the compatibility of the two constituent agents. 

^^. Possible applications include the human dating scenario, and the commercial domain 

where two types of businesses A and B have members of each type looking for a 
K^ business partner, i.e. Ai + Bj — > Rij. The pair Rij then survives for some finite time 

p^J ' before dissociating Rij -^ Ai + Bj. There are many possible generalizations of this 

'nJ" i basic setup. Here we content ourselves with some initial numerical results for the 

.,jj. ' simplest of network topologies, together with some accompanying analytic analysis. 
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1 Introduction 



The formation of pairs or 'relationships' between members of two distinct 
populations, is a phenomenon which is of central importance in a number of 
application domains: from animal and human societies through to commerce 
and politics. Here we consider a simple yet highly non-trivial model of such a 
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dynamical process, in which we allow such pairs to form and break up based 
on an appropriate measure of their mutual compatibility. Although there are 
many possible variations and generalizations according to the particular real- 
world system of interest, we content ourselves here with an analysis of the 
basic model itself, both numerically and analytically. 

Specifically, we consider a system comprising two populations A and B. Pop- 
ulation A contains Nj^ agents, while population B contains Nb agents. All 
agents are assumed to be able to move freely on a network. In future work, 
we will explore the effects of specific network topologies which are designed to 
mimic the real-world social/business space within which such agents move, for 
example scale-free or small- world networks [5]. However in the present paper, 
we focus on results which are either generic to all networks or which hold for 
a specific simple network. 

As the agents move on the network, they will interact with each other on a 
given timestep if they happen to find themselves on the same node. Members 
of each population wish to form a pair or 'relationship' with a member of the 
other population. We allow the members of each population to have their own 
list of characteristics (or equivalently, preference list or 'phenotype'). Upon 
finding each other, a given pair will stay together a finite amount of time 
which depends on the similarity of their respective lists - this mimics a rela- 
tionship whose duration depends on the relative compatibility of the individual 
agents comprising the pair. In other words, Ai + Bj -^ Rij where the pair Rij 
survives for some finite time before dissociating Rij ^ A^ + Bj. The goal of 
each individual is to maximize the time it spends in a partnership. One inter- 
esting application is in the human dating scenario comprising the two distinct 
populations (male and female) where members of each sex are looking for a 
partner with which to form a relationship. 

The layout of the paper is as follows: Section 2 gives further details of the 
model. Section 3 provides the main results while Section 4 presents the con- 
clusions. We find numerically that there is a highly non-linear relationship 
between expected utility, the threshold for formation of a relationship, and 
the degree of sophistication of the individual agents. In order to explain this 
finding, we develop an analytic theory which depends on the average period 
of time which an agent spends in a pair and the probability of finding a 
suitable partner on the network. The agreement between the analytic results 
and the numerical calculations is good, despite the fact that this problem is 
more complicated than standard react ion- diffusion problems - in particular, 
our particles (i.e. agents) have non-trivial internal degrees of freedom deriving 
from their preference lists. Ae mentioned above, we focus here on a basic ver- 
sion of the model although the analysis should be generalizable to any single 
component network within which the agents explore. 



Before proceeding, we comment on the difference between the present model 
and the so-called 'stable marriage problem' [2,3]. The latter has been inves- 
tigated many times in the literature, typically using a Nash Equilibrium ap- 
proach to optimize the local utilities of two lists of agents which are looking 
to pair up. When this equilibrium exists, any change of the state of the sys- 
tem caused by an agent altering its choice, results in a worse performance for 
that agent [2]. The agents try to minimize their 'energy' by marrying someone 
who fills as many of their criteria as possible. However unlike most traditional 
stable marriage analysis, we will not look at minimizing the system's 'energy' 
[3] as a whole - our rationale being that in many real-world systems, there 
is no opportunity for exchange of global information in order to optimize the 
system. Instead, agents are restricted to interacting with others who occupy 
the same node thereby accessing only a subset (albeit dynamic) of the whole 
social network. Likewise the timescales required to explore and subsequently 
optimize one's own local utility, are not typically achievable in systems where 
agents only exist for a finite time. Moreover in contrast to recent models of 
business formation and/or collapse [4], the local utility of an agent in our 
model who is choosing whether or not to enter a partnership, is not based on 
the intrinsic value of being instantaneously single - instead it is based on the 
expectation of future satisfaction. 



2 Model of Pair Dynamics 



We consider the agents to be moving freely on a spatial network, with each 
individual placed at a random initial location. The agents undergo a random- 
walk around this network, occupying a particular site at a given timestep. If 
there exist one or more single agents from each population on a given node at a 
given timestep, then one or more relationships might form. In particular, each 
(single) agent is allowed to interact with one (single) agent chosen randomly 
from the members of the opposite population who are currently on that same 
site. There is no sense of optimization in this pair-formation process: as in 
many real-world scenarios, the agents do not know prior to this interaction 
how well-suited a potential partner might be. A pair of agents can only find 
out their 'compatibility' after they have interacted, and this is restricted to 
once per timestep. Hence if, for example, there exist more single agents from 
population A than from population B on any particular node at a given 
timestep, then the number of agents which do not interact at all at that 
timestep is given by this excess number of population A agents. 



We express the compatibility of two agents Ai and Bj as follows ^ : 

Q, = "^'^^ ^ (1) 

where a^ and bj are vectors representing the preference lists of agents Ai and 
Bj respectively, with elements restricted to ibl, and S is the length of these 
lists ^ . The compatibility Cij lies in the region < C^- < S and is equal 
to S minus the Hamming distance [7] between the two vectors. We use the 
compatibility Cij to prescribe the duration of a relationship between a given 
pair, in the case that the pair actually forms. Again this could be generalized to 
allow for exogenous perturbations, e.g. subsequently meeting more compatible 
partners - but here we shall assume that all relationships last for the assigned 
duration. In particular, we here assume that the lifetime of a given pair is a 
monotonically increasing function of the compatibility Cij. In principle, such 
a lifetime could be generated by making the relationship a dynamic system 
whereby each agent calculates a utility associated with the relationship, such as 
the Cobb-Douglas [4] utility function - and an agent then chooses to leave the 
pair when the descent to some equilibrium falls below some critical threshold. 
In the situation whereby a particular single agent is exposed to a random 
single agent from the other population, the compatibility will be binomially 
distributed, C e Bin{S, |) as shown in Fig. 1. 

In order to mimic real-world scenarios, we choose a game set-up whereby 
agents do not enter a relationship if Cij falls below some critical level which 
we call the compatibility threshold r. The value r could be allowed to vary 
between agents and/or evolve due to past experiences, with the minimum r 
being the critical one in a given potential pair - however in this work we 
focus on the case where all agents have the same r and where r is time- 
independent. The goal of each agent is to maximize its own utility, i.e. the time 
it spends in a relationship. The value associated with being in a relationship 
in a given timestep is binary (see Fig. 2) with the compatibility then deciding 
the duration of the relationship. 



^ This definition of compatibility between agents' preference lists is similar in con- 
struction to the similarity of strategies in Binary Agent Resource games such as 
the Minority Game, where strategies are represented by bit-strings of a particular 
length. In particular, the similarity of strategies i and j is given by the Hamming 
distance [7] between their respective bit-strings [1]. 

^ This setup could be generalized by assigning each agent a separate set of pref- 
erences and attributes. The value assigned to the compatibility of a given pair of 
agents, could then be different for each agent in that pair. The subsequent pair- 
formation rules would need to be modified to include this feature. We also note that 
the notion of beauty could be introduced into the model setup, by biasing how the 
preference lists are allocated at the start of the game. 
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Fig. 1. The compatibility Cij of two agents which are randomly chosen from popula- 
tions A and B respectively, where A and B have uniform 'phenotype' distributions 
(i.e. the distribution of the randomly allocated preference lists is uniform). For il- 
lustration, we have used S = 12. 
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Fig. 2. The (binary) utility associated with an agent being in a relationship. 



3 Numerical and Analytic Analysis of Pair Dynamics 



Each agent at any given tiniestep can either be in a relationship (R) or not 
in a relationship (nR). The expected utility per unit time for any given agent 
can be expressed as the average time spent in a relationship over a given time 



period, as shown schematically in Fig. 2. This can be written as follows: 

U = ^ (2) 

where /ir is the expected duration of a relationship and finR is the expected 
duration of any non-relationship spell - in other words, the expected time 
before successfully forging a relationship having started in the nR state. This 
result is general and applies to any agent in an arbitrary network. Assuming 
random interactions between agents as they wander randomly through the 
network, the fiR term can be calculated from the distribution of C and the 
function D{C), which prescribes the relationship's duration for a given com- 
patibility. For an nR agent, the probability that it will remain in state nR for 
a further timestep will be one minus the probability of successfully forging a 
relationship. As such, the value finR is governed by a geometric probability 
distribution and can be calculated accordingly: 
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Here Psuccess is the probability of an nR agent from A or B, interacting with an 
nR agent from B or A and successfully forming a relationship. We can rewrite 
Psuccess as the probability of interacting with a potential partner Pint and 
the probability of successfully forming a relationship once a potential partner 
is engaged (i.e. Pr). Assuming random interactions, the latter is merely a 
summation based upon the compatibilities which would allow a relationship 
to happen (given the threshold r) and their respective likelihoods. As such, 
we can write ^r and /i„i? in terms of Pint and Pr. 
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We note that the effect of the movements of the agents on any particular 
network, is embodied in the probability term Pint- As an example, we consider 
the simplest topology of network - one node - and a simple function for the 



pair lifetime D{C) = «(§) + P- All agents' expected interactions are equal 
for this system, hence the mean utility over all agents will be the same and is 
given by ([/) agents = U. With Na = Nb = A^, the average time required for 
meeting a potential partner by an agent who has been in state nR (because of 
failing to overcome the threshold) is unity since Na = Nb and all agents are 
in the same place. As such, Pint = 1- Substituting Eq. 4 and Eq. 5 into Eq. 2, 
the expected utility per timestep averaged over all agents can be written: 
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(7) 



The dependence on the threshold r will become more important for more 
sophisticated agents (i.e. higher S and hence longer attribute lists) since the 
likelihood of meeting a perfectly compatible agent then becomes low. This 
effect can been seen in Fig. 3 which indicates the highly non-linear relationship 
between the average utility, the threshold r and the level of sophistication S. 
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Fig. 3. The average utility {U) as a function of t/S. This shows the importance of 
r with increasingly sophisticated populations, i.e. longer attribute lists and hence 
larger S. These curves are calculated for a network comprising just a single node, 
hence the interaction probability Pint = 1. Also a = 20 and /3 = 1. 



For a more general network structure, we must calculate or infer from numeri- 
cal simulations the interaction probability of those agents not in a relationship, 
i.e. Pint- This term will depend on the details of how the agents move and the 



topology of the particular network. It will also be a function of the number of 
potential partners available, and hence is linked to the initial number of each 
population {Nj^, Nb) and the fraction of these who are currently in a pair. If 
the agents are moving randomly on a highly-connected or crowded network, 
then the interactions between particular phenotypes will be random. This will 
also be true for a situation in which agents forming a pair do not physically 
stick to each other, but rather roam independently throughout the lifetime of 
that relationship. Under these conditions, P{C) will again be binomially dis- 
tributed and the utility of the individual over time can be calculated. Again, 
all agents' expected interactions are equal so {U)agents = U. 

We now consider the situation in which the time-averaged number of single 
agents from each population on any node is uniform over the entire network. 
This would be appropriate to networks where the degree of each node is iden- 
tical (e.g. the fully connected graph). Future work will discuss relaxing this 
restriction to general topologies. Specifically, we focus on two regimes: over- 
crowded and undercrowded. In the overcrowded situation, there are more po- 
tential partners than nodes. As each agent can only test for compatibility once 
per timestep, any difference in the number of agents from each population on 
a particular node at a particular time will result in a group which cannot in- 
teract with a potential partner. For example, if there are 5 type-A agents and 
3 type-B agents in state nR on a particular site, then 2 type-A agents will 
not be able to interact with a potential partner. If there are large fractions 
of the populations in state nR as compared to the number of nodes, we can 
approximate the (binomial) distributions of each population on a particular 
site by Normal distributions. For a total of A^ agents of each population, the 
number in state nR will be A(l — (U)). By integrating over the distribution 
of the difference of nR agents from each population on a particular node, we 
can calculate the subsequent expectation number of non-interacting agents. 
On a network of n nodes, we can then write the probability of interaction for 
a given agent of either population as follows [6] : 
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In the undercrowded regime, the probability of having more than one agent 
of a given population on a particular node is small. Hence the probability of a 
given agent meeting a potential partner can be described as follows (see Ref. 
[6] for details): 
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These two approximations are only strictly valid in the limits A^(l — (U)) ^ n 
and A^(l — (f/)) -C n respectively. However, in what follows we will show that 
these expressions turn out to be reliable in practice over the wider ranges 
iV(l — ([/)) > n and iV(l — {U)) < n. Figure 4 shows the values of Pint for the 
two ranges, calculated using the two respective expressions. Substituting Eq. 
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Fig. 4. Analytic results for the interaction probability Pint for the overcrowded and 
under crowded regimes. 



4 into Eq. 2 yields the expected utility for agents in this type of network: 

Comparison of Eq. 10 to the expressions for Pint (Eq. 8 and Eq. 9) results 
in two sets of simultaneous equations (one set for each regime) which we can 
then solve numerically for (U) for a given network. 

Figure 5 shows that the results obtained using the analytic expressions do 
indeed compare very well to those from numerical simulations. The numerical 
simulations are performed here on a fully connected network. This positive 
result gives us confidence that similarly accurate results might be obtained for 
more general networks. We will explore this in a future publication. 
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4 Conclusion 



We have introduced and analyzed a simple model of agent interactions on a 
network, using a binary utility function to describe the lifetime of a given 
pair. We have focused on the specific case in which the system is in a mixed 
state such that the interactions between agents are not biased. The analysis 
can however be generalized to any network topology and payoff function, by 
considering the corresponding interaction probabilities and utility weighting. 
Further provision could be made to include biased interactions (e.g. where 
an individual is more likely to encounter its previous partner). If we consider 
a specific agent who wants to maximize its local utility in such a situation, 
changing phenotype will have no effect - however a conscious decision to re- 
main at a particular hub {Pint — ^ 1) could have a dramatic effect. 
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Simulaiion Values 




Analytical Results 
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Fig. 5. Comparison of the values of {U) obtained from numerical simulation, to 
those obtained using the analytic expressions in the overcrowded and undercrowded 
regimes. The phenotype (i.e. preference list) length is S" = 12. The total number of 
agents from each population is A^ = 500, while a = 20 and /3 = 1. The simulation 
is performed on a fully-connected graph. 
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